The Generative Audiovisual Narrative System
نویسنده
چکیده
This paper documents the results of a research project that deals with the application of an artificial life (AL) approach to creating a system of cinematographic narration. This project investigates the possibility of producing an autonomous cinematographic narration system, in which meaning results from a kind of hypermontage, conditioned by genetic algorithms. The theoretical thesis lead to the design and construction of a generative system for the synthesis of audiovisual narratives, in which a genetic algorithm manages the collection of video fragments, that have been parameterized and stored in a database. The genetic algorithm’s fitness criteria are being defined by the viewer, via the system’s interface. During the presentation of this paper, the system and its audiovisual results will be demonstrated. This paper investigates whether individual video fragments belonging to a database may be linked into numerous different successions in order to satisfy fitness criteria defined by the user. The aim is to create optimum sequences in accordance to specific requirements, instead of coming up with a closed predetermined unique sequence, as it’s traditionally done by directors. Fragmented videos as micro-narrations are composed to a greater whole which is unique, since the system has never given the same result twice. Taking the phenomenon of semantic montage as an axiom, the viewer attributes causality relationships to the succession of these fragmented micro-narrations which are seamlessly integrated in the sequence. A traditional work of art may be read in multiple ways, which depend on the subjectivity and arbitrariness of the spectator-reader. In the case of AL, the multiplicity of the artwork mainly depends on the manner in which the artifact is being written. Having the same structural elements as a starting point may result in different readings. Having the same data as a starting point, may lead to different versions of the same work of art. GA2008, 11th Generative Art Conference Page 223
منابع مشابه
Incorporating Authorial Intent into Generative Narrative Systems
One of the major themes to emerge in interactive narrative research is authorability and authorial intent. With interactive narratives, the human author is not present at run-time. Thus authoring interactive narratives is often a process of anticipating user actions in different contexts and using computational mechanisms and data structures for responding to the participant. Generative approac...
متن کاملNarrative processing in typically developing children and children with early unilateral brain injury: seeing gesture matters.
Narrative skill in kindergarteners has been shown to be a reliable predictor of later reading comprehension and school achievement. However, we know little about how to scaffold children's narrative skill. Here we examine whether the quality of kindergarten children's narrative retellings depends on the kind of narrative elicitation they are given. We asked this question with respect to typical...
متن کاملConstructing narrative using a generative model and continuous action policies
This paper proposes a method for learning how to generate narrative by recombining sentences from a previous collection. Given a corpus of story events categorised into 9 topics, we approximate a deep reinforcement learning agent policy to recombine them in order to satisfy narrative structure. We also propose an evaluation of such a system. The evaluation is based on coherence, interest, and t...
متن کاملOn Movement, Structure and Abstraction in Generative Audiovisual Improvisation
This paper overviews audiovisual performance systems that form the basis for my recent collaborations with improvising musicians. Simulations of natural processes, such as fluid dynamics and flocking, provide the foundations for “organic”looking movement and evolution of abstract visual components. In addition, visual components can morph between abstract non-referential configurations and pre-...
متن کاملControlling narrative time in interactive storytelling
Narrative time has an important role to play in Interactive Storytelling (IS). The prevailing approach to controlling narrative time has been to use implicit models that allow only limited temporal reasoning about virtual agent behaviour. In contrast, this paper proposes the use of an explicit model of narrative time which provides a control mechanism that enhances narrative generation, orchest...
متن کامل